Probing non-tensorial polarizations of stochastic gravitational- wave backgrounds 

with ground-based laser interferometers 
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In a general metric theory of gravitation in four dimensions, six polarizations of a gravitational 
wave are allowed: two scalar and two vector modes, in addition to two tensor modes in general 
relativity. Such additional polarization modes appear due to additional degrees of freedom in mod- 
ified theories of gravitation or theories with extra dimensions. Thus, observations of gravitational 
waves can be utilized to constrain the extended models of gravitation. In this paper, we investi- 
gate detectability of additional polarization modes of gravitational waves, particularly focusing on 
a stochastic gravitational-wave background, with laser-interferometric detectors on the Earth. We 
found that more than three detectors can separate the mixture of polarization modes in detector 
outputs, and that they have almost the same sensitivity to each polarization mode of stochastic 
gravitational-wave background. 

PACS numbers: 04.50.Kd, 04.80.Cc, 04.80.Nn. 



I. INTRODUCTION 

In recent years, direct detection experiments of 
a gravitational wave (GW) have been well devel- 
oped. The first generation of a kilometer-scale ground- 
based laser-interferometric GW detector, located in the 
United States (LIGO), Europe (VIRGO and GEO 600), 
and Japan (TAMA 300), has begun its search for 
gravitational- waves and has yielded scientific results: es- 
pecially for a stochastic gravitational-wave background 
(GWB), the upper limit on the energy density has been 
obtained [l|, [2 ll]- However, the first detection of the 
GW has not been achieved yet. The development of in- 
terferometers of the next generation, such as AIGO 4|, 
advanced LIGO 5], advanced VIRGO [6], and LCGT 0, 
is underway. In the coming decade, a direct detection of 
GWs will be made, and the GW experiments will be a key 
observational tool to obtain valuable information about 
astronomical objects and physics of the early universe. 

The direct observation of the GWs will also provide a 
unique opportunity to test the theory of general relativ- 
ity (GR), through the propagation speed, waveforms, and 
polarization modes of GWs. In GR, a GW has two polar- 
ization modes (plus and cross modes), while in a general 
metric theory of gravitation, the GW is allowed to have, 
at most, six polarizations [1, Q. In the extended theory 
of gravitation such as Brans-Dicke theory [l^, [IH and 
f{R) gravity the GW has additional polarization 
modes, because of extra degrees of freedom involved with 
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scalar fields. In the theories with extra dimensions such 
as the Kaluza-Klein theory and the Dvali-Gabadadze- 
Porrati (DGP) braneworld model [l^, gravitons are able 
to propagate into extra dimensions, and have additional 
polarizations. If additional polarizations are found, it 
indicates that the theory of gravitation should be ex- 
tended beyond GR, and excludes some theoretical mod- 
els, depending on which polarization modes are detected. 
Thus, the observation of the GW polarizations is a pow- 
erful tool to probe the extended law of gravity and extra 
dimensions. Subsequently, we can also investigate the 
accelerated expansion of the universe [13, . 

Currently, there are few observational constraints on 
the additional polarization modes of GWs. For the 
scalar GWs, the observed orbital-period derivative of 
PSR B1913-I-16 agrees well with predicted values of GR, 
conservatively, at a level of 1 % error [l^ , indicating 
that the contribution of scalar GWs to the energy loss 
is less than 1 %. Another constraint on a scalar GWB 
has been obtained from the amplitude of scalar per- 
turbations in the WMAP data, which corresponds to 
^o^fw ^ 10"^^ 0, [II, where the critical density of 
the universe is pc = SHq/SttG and the Hubble constant 
is Ho = lOO/iokms-^Mpc-^ 

On the other hand, little work on a direct search has 
been done so far, except for the recent work by Lee, Jenet, 
and Price fl§\. The authors have investigated the de- 
tectability of non-Einsteinian (non-GR) polarizations of 
a GWB at the frequencies, ~ 10^^ Hz, with pulsar tim- 
ing, and showed that the non-Einsteinian polarizations 
can be discriminated with 40 - 60 stable pulsars. In this 
paper, using multiple laser-interferometric GW detectors 
on the Earth (at 100 Hz), we present a method for sep- 
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arating a mixture of the polarization modes of the GWB 
and detecting non-tensorial polarization modes. 

This paper is organized as follows. In SecHJ we de- 
fine the six polarization modes of a GW. In Sec. lIIIl we 
investigate the response of a single detector to the GW 
propagating in a certain direction with each polarization 
mode. In Sec. lIVl we focus on a GWB, and describe cross- 
correlation between two detectors, extending the analysis 
to the non-tensorial polarizations. Then, we discuss an 
optimal location and orientation of the detectors, and 
the detectability of the GWB with a single polarization 
mode. In Sec.|Vl we consider the separation of a polar- 
ization mode using multiple detectors, which is the main 
subject of this paper, and estimate the detector sensi- 
tivity to the GWB for various combinations of multiple 
detectors. Finally, Sec. lVIl is devoted to conclusions and 
discussions for future prospects. 



II. GW POLARIZATION MODES 

In general, a metric gravity theory in four dimensions 
allows, at most, six polarization modes of a GW [1, Q. 
If a spacetime includes extra dimensions, the number of 
polarization modes can be more than six. However, once 
the polarizations are projected onto our 3-space, the po- 
larizations we observe are degenerate, and are classified 
into six polarizations. For the GW propagating in the z 
direction, the bases of the six polarizations are defined 
by (a;, y, and z components are from the left to the right 
or the top to the bottom in the tensors.) 
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where -|-, x, 6, x, and y denote plus, cross, breath- 
ing, longitudinal, vector-x, and vector-y modes, respec- 
tively. The tildes are fixed to represent that the po- 
larizations are defined in our 3-space, not in a space- 
time with extra dimensions. Each polarization mode 
is orthogonal to one another and is normalized so that 
e^e^, = 2b AA', A, A' = +,x,b,£,x, and y. Note that 
the breathing and longitudinal modes are not traceless, 
in contrast to the ordinary plus and cross polarization 
modes in GR. In Fig. [2 we illustrate how each GW po- 
larization affects test masses arranged on a circle. Ac- 
cording to rotation symmetry around the propagation 
axis of the GW, the -I- and x modes can be identified 
with tensor-type (spin-2) GWs, the x and y modes are 
vector-type (spin-1) GWs, and the b and £ modes are 
scalar-type (spin-0) GWs. 



The polarization modes in various alternative theories 
are summarized in Table |T1 All polarizations do not nec- 
essarily appear in all theoretical models. Most of the 
gravity theories in cosmologically interesting situations 
are the variant of the scalar-tensor theory, where no vec- 
tor polarization appears. 



III. RESPONSE OF A SINGLE GW DETECTOR 

In this section, as preliminaries of later analysis, we 
consider the response of a single detector to a GW 
propagating in a certain direction. A perturbed met- 
ric hij, which represents the GW propagating in three- 
dimensional space, is decomposed into the six polariza- 
tion modes as 



k ■ x) = h^{uot — k ■ x)e^- + hy^{ijjt — k ■ x)e 



+ hb{Lut — k ■ x)e,j^j + he{Lut — k ■ x)e^^ 

+ hx{ujt ~ k ■ x)e^^ + hy{ujt — k ■ x)ef^- , 

where Ha, A — +, x,b,£,x, and y are the amplitudes of 
GWs for each mode. 

Although a detector output actually depends on the 
GW amplitude determined by a specific theoretical 
model, we can discuss the detector response to each 
GW polarization without specifying a certain theoreti- 
cal model. The angular pattern function of a detector to 
GWs is given by 



FA{n) = D : eA{n) 
1 . 
2 



(2) 



D 



U (XI U — V ( 



where the symbol : denotes contraction between tensors, 
and D is a so-called detector tensor, which describes the 
response of a laser-interferometric detector and maps the 
gravitational metric perturbation to a GW signal from 
the detector. The unit vectors u and v are orthogonal to 
each other and are directed to each detector arm, which 
form an orthonormal coordinate system with the unit 
vector w, as shown in Fig. [21 f2 is the unit vector directed 
at the GW propagation direction. Note that the detector 
tensor, Eq. is valid only when the arm length of the 
detector is much smaller than the wavelength of GWs 
that we consider. This is relevant for our purpose to deal 
with the ground-based laser interferometers. 

Suppose that an orthonormal coordinate system for 
the detector is 

' fl= (1,0,0) 
v = (0,1,0) , 
W= (0,0,1) 

and the GW coordinate system rotated by angles {6, </>) 
is 

u' = (cos 6 cos (j), cos 9 sin (j), — sin 9) 
v' = (— sin (f), cos (j), 0) 
w' = (sin 6 cos sin 6 sin (p, cos 6) 
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(a) plus mode (c) breathing mode (e) vector-x mode 




(b) cross mode (d) longitudinal mode (f) vector-y mode 



FIG. 1: (color online). Six GW polarizations in a general metric theory of gravitation. The two ellipses (or circles) show the 
effect of a GW with each polarization on test masses arranged on a circle at the moments of different phases by vr. The symbol 
Q and the arrow represent the propagating direction of the GW. 
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TABLE I: GW polarization modes in various theories. In a general five-dimensional spacetime, two scalar modes are correlated 
and behave as one degree of freedom. ^In the case that graviton is massless (rrig — 0), the longitudinal mode vanishes. On the 
other hand, in the case of massive graviton (rrig 7^ 0), the breathing and longitudinal modes are correlated. 

The most general choice of the coordinates is obtained shown in Fig.[2l Using the unit vectors m, n, and ft, the 
by the rotation with respect to the angle around the 
GW-propagating axis, 

m = u' cos tjj + v' sin ip 
n = — v' sin ifj + u' cos ^ . 

The coordinate system (u, v,w) is related to the coordi- 
nate system (rh, n, fi) by the rotation angles 9, ■0), 
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FIG. 2; (color online). Coordinate systems. 



polarization tensors in Eq. ([T]) can be written as 
e+ = m(8)m — ri®ri, 

e£ = \/2J7 (g) r2 , 
= n(8) $7 + f2 ( 



I n 



Then, from Eqs. ([2]), the angular pattern functions for 
each polarization result in 



F+{e,4>,ip) = i(l + cos2 6')cos20cos2'(/' 

— cos sin 20 sin 2-0 , 
Fy,{e,(l),ip) = + cos^6l)cos20sin2V' 

— cos 9 sin 20 cos 2tp , 



Fx{9,(t),tp) = sin (cos 6* cos 20 cos — sin 20 sin 0;) 



(3) 
(4) 

(5) 

sin 6 (cos 6* cos 20 sin i/j + sin 20 cos ip) , 

(6) 



Ffc(6',0) = -isin2 6lcos20 , 

Fe{e,<j)) = ^ sin^ 6* cos 20 . 
v2 



(7) 
(8) 



From the dependence on the angle ip, the + and x modes 
are tensor type (spin-2), the x and y modes are vector 
type (spin-1), and the b and £ modes are scalar type 
(spin-0). The angular pattern functions of the breath- 
ing and longitudinal modes are completely degenerated, 
which prohibits one to decompose the two scalar modes 
with a laser-interferometric GW detector. We plot the 



angular pattern functions for each non-tensorial polar- 
ization in Fig. [21 and the angular pattern functions for 
the tensor, vector, and scalar modes in Fig.01 These re- 
sults are consistent with those obtained in [2a @, Hi • 



IV. CROSS CORRELATION 

We focus on a stochastic GWB based on the de- 
tector responses obtained in the previous section, and 
discuss cross correlation between a pair of detectors. 



A. Correlation analysis 

To distinguish the GWB signal from stochastic de- 
tector noise independent in each detector, one has to 
correlate signals between two detectors. The correla- 
tion analysis has been well developed by several authors 
[13, mi, 1121 ■ In this section, we extend the method to the 
non-tensorial polarizations. 

At a position X, the gravitational metric perturbations 
in our 3-space are given by 

h(t,x) = V / dn r dfhA{f,n) 



xe 



27ri/(t-0-X/c 



(9) 



where hA{f, i^) is the Fourier transform of the GW am- 
plitude with polarizations A = +,x,6, x, and y. In 
Eq. ([9]), we assumed that gravitons propagate with the 
speed of light in our 3-space. Strictly speaking, gravi- 
tons propagate with the speed less than that of light, 
if they are massive in some modified gravity theories or 
are projected onto our 3-space in the presence of extra 
dimensions. However, the mass is constrained by sev- 
eral observations of the galaxy [s^ , the solar system [13| , 
and binary pulsars [1^. The limits from the galaxy and 
the solar system are obtained from the observation in 
static gravitational fields, while the limit of binary pul- 
sars comes from the change of the orbital period of the 
binary pulsars (PSR B1913-hl6 and PSR B1534-M2), in 
dynamical gravitational fields (The limit from the galaxy 
is the most stringent, but may be less robust.). Thus, 
here we adopt the binary pulsar bound. Finn and Sut- 
ton (35j considered energy loss from the binary system by 
emission of massive gravitons, and obtained the limit on 
the mass of gravitons, (mg/worbit)^ < 0.003, where Worbit 
is the orbital frequency of the binary. This limit implies 



c 



Worbit 



> 0.998 , 



The gravitons cannot change their speed by more than 
0.2% from the speed of light. Thus, setting Vg = c does 
not affect cross-correlation analysis qualitatively. Here- 
after we set Va = c. 
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(e) \X 

FIG. 3: (color online). Angular pattern functions of a detector for each polarization, (a) Plus mode j-F+l, (b) cross mode 
I -Fx I, (c) X mode \Fx\, (d) y mode \Fy\, and (e) longitudinal mode \Fe\. The angular pattern function of the breathing mode 
is the same as that of the longitudinal mode except for an overall factor l/\/2. At the center of the figure, the arms of an 
interferometer are shown. 



Using Eqs. ^ and GW signal h{t) can be written 

as 

h{t,x) = V / dn r dfhA{f,n) 

e^"-^(*^^-*/")FA(/,ri) . (10) 
Thus, the Fourier transform of Eq. (fTO|) is 

Kf) = Y.I dnhA{f,n)e-'^^i'^-^/^FA{f,n). (ii) 



We assume that a stochastic GWB is (i) isotropic, (ii) 
independently polarized (not correlated between polar- 
izations) [i^ . (iii) stationary, and (iv) Gaussian, which 
are discussed in [321. Then, all the statistical properties 
of the GWB are characterized by 

{h*Aif,n)hA'if\n')) = 6{f-f')^s^{n,n')6AA'lstm , 

(12) 

where S'^iCl,^') = S{(t) - (t)')S {cos 9 - cos 9'), and (• • • ) 
denotes ensemble average. S^{f) is the one-sided power 



Tensor 

FIG. 4: (color online). Angular pattern functions of a detector 
left are J Fl + , + F^, and ^F^+F'l, respectively. 



spectral density of each polarization mode. 

Conventionally, the amplitude of GWB for each polar- 
ization is characterized by an energy density per loga- 
rithmic frequency bin, normalized by the critical energy 
density of the Universe: 

(13) 

where Pc = 3Hq/8ttG and H n is the Hubble constant. 
f2gw(/) is related to Sh{f) by 

^tif) - (IJ) fS^^if) . (14) 

Note that the above definition is different from that in 
the literature [H, [s^, by a factor of 2, since it is defined 
for each polarization. It is convenient to represent the en- 
ergy density with the form /iQr2gw(/) by parametrizing 
the Hubble constant as Hq = 100 /iq kms~^ Mpc~^. We 
assume that -I- and x modes are not polarized (The de- 
tectability of circular polarizations in the polarized case 
has been discussed in [s^, [H, [H, H^.). We also assume 
that X and y modes are not polarized. In most of the cos- 
mological scenarios, these assumptions are valid. Then, 
the GWB energy density of tensor, vector, and scalar 
modes can be written as 

^gw = ^gw ~^ ^gw (^gw ~ ^gw) J (15) 

^gw = ^gw + ^gw (^gw ~ ^gw) J (16) 

gw gw gw 

= f^gw(l + «^) , (17) 

where the ratio of the energy density in the longitudinal 
mode to that in the breathing mode is characterized by 
the parameter k = flg^/ilg^. 

Let us consider the outputs of a detector, s{t) = h{t) + 
n(t), where h{t) and n{t) are the GW signal and the noise 



Scalar 

for the tensor, vector, and scalar modes. The plots from the 



of a detector. We assume that the amplitude of GWB 
is much smaller than detector noise. Cross-correlation 
signal Y between two detectors is defined as 

Y=l dt dt' si{t)sj{t')Q{t-t') , (18) 

J-T/2 J-T/2 

where sj and sj are outputs from the I-th and J-th de- 
tectors, and T is observation time. Q{t — t') is a filter 
function, which is later introduced so that signal-to-noise 
ratio (SNR) is maximized. In terms of the Fourier repre- 
sentation, we obtain 

df df6T{f~nrAf)sj{nQ{n m 

-OO J ~oo 

where si(/), S2(/) and Q{f) are the Fourier transforms 
of si(t), S2{t) and Q{t — t'), respectively. The function 
(5t(/) is defined by 

J-T/2 I"/ 

In the above derivation, we took the limit of large T for 
one of the integrals. This is justified by the fact that, in 
general, Q{t — t') rapidly decreases for large |i — In the 
absence of intrinsic noise correlation, the correlation sig- 
nal obtained above ideally has a contribution from only 
the GWs. Thus, taking the ensemble average of Eq. (fTO|) 
leads to 

M ^ {Y) 

/OO nOO 
df / df'STif- f'm{f)hj{r))Q{r). 
-OO J — OO 

(20) 

Substituting Eq. ^ into Eq. ^ and using Eqs. IT^ 



Vector 
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and (|14p . we obtain 



o fr2 /-oo 



207r2 



Qif), (21) 



where we defined 



and 



AX = Xr 



1 / l + 2« 
^ ~ 3 V 1 + K 



The parameter ^ is in the range 1/3 < ^ < 2/3 and 
characterizes the ratio of the energy in the longitudinal 
mode to the breathing mode. We also defined overlap 
reduction functions 



lYAf) 
ifAf) 



dn 

2 Jg2 47r 



2 Jg2 47r 



(22) 



(23) 



15 
1 + 2k 



Jg2 An 



(24) 

These functions are normalized so that they give unity in 
the low- frequency limit, which is easily verified by using 
Eqs. ([3]) - ([5]). The overlap reduction function represents 
how much degree of correlation between detectors in the 
GW signal is preserved. 

Next, we will calculate the variance of the correlation 
signal. Here we assume that noises in two detectors do 
not correlate at all and that the magnitude of the GW 
signal is much smaller than that of noise. Consequently, 
the variance of the correlation signal is 

^2 = (Y^) - (F)2 « (Y^) , (25) 

where the weak-signal assumption for the GWB is used. 
Then, using Eq. , it follows 

/oo 
df'Qimif) 
-oo 

df / df'Q{f)Q*{f') 



T 



dfPimpjmm)\'. (26) 




FIG. 5: (color online). Coordinate system on the Earth for a 
detector pair. 



where the one-sided power spectrum density of noise is 
defined by 



(«}(/)«,(/')) ^i<5(/-m(i/i), 



1,2. 



Now we can determine the form of the optimal filter 
Q{f). Equations (PTjl and (pS]) are expressed more sim- 
ply, using an inner product 



{A,B) 



as 



dfA*{J)BU)Pi{\f\)PA\f\). 



^Hlrr^fA 7(l/l)»gw(|/|) \ 



207r 
T 



\i?PimpA\f\)j 



4(^'^) 



(27) 
(28) 



where ri3w7^ + ^^7^ + C ^gw7'^ is simply written by 
7r2gw. From Eqs.^jSIl and the SNR for GWB is 

defined as SNR = ji/a. Therefore, the filter function, 
which maximize the SNR , turns out to be 



QU) - K 



7(./)»gw(|/|) 

\f?pimpA\f\y 



(29) 



with an arbitrary normalization factor K. Applying this 
optimal filter to the above equations, we obtain the op- 
timal SNR 



SNR = 



107r2 



df 



pPimpA\f\) 



1/2 



(30) 



where 17gw7 = f^gw7^ + f^gw7^ + C f^fw7^- 

B. Overlap reduction function 

Here we present the analytical expressions for the over- 
lap reduction functions given in Eqs. (|^^ - P^ . perform- 
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ing the angular integrals by expanding the overlap reduc- 
tion functions with tensorial bases. Following [32| . they 
are, in general, expressed in terms of the detector tensor 
Dij, and a unit vector di, defined by di = AX /\AX\: 

ifAf) - pria)D^/D'^^+p^'{a)D}^,DydJ, 

+pl'ia)D'/DfdJ,dkdi , (31) 
M = T, V, and 5, together with 
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for the tensor mode, 
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Tensor mode 



7^ (a, f3, cr+, cr_) 



eT-(a, 13) 



Qr+ioi, (3) cos(4o-+) 
+eT-(a, P) cos(4cr_) , (33) 



3 . 45 169 

8^" "56^^ + 896^^ 



1 . 5 . 27 , \ 

2Jo-yj2-^j4j cos/3 

-ioJo + ^^n + ^M) cos 2/3, 

(34) 

Jo + ^j2 + ^j4)cos(^) ,(35) 



for the vector mode, and 



• Vector mode 







(1) 









14 20 6 
-60 -60 
105 




(32) 



for the scalar mode. Details of the derivation are summa- 
rized in Appendix TK] Here, jnio-) is the spherical Bessel 
function with its argument given by 



_ 27r/|AX| 



To further investigate the dependence of the overlap 
reduction function on the detector configurations, espe- 
cially for ground-based detectors, we introduce the co- 
ordinate system on the Earth shown in Fig.[51 This 
coordinate system significantly simplifies the expression 
in Eq. (|3T|) . The relative location and orientation of 
two detectors are characterized by the three parameters, 
(/?, (Ti, (72). The /3 is the separation angle between two 
detectors, measured from the center of the Earth. The 
angles (Ti and (T2, are the orientations of the bisector of 
two arms of each detector, measured in a counterclock- 
wise manner relative to the great circle connecting the 
two detectors. The distance between two detectors is 
given by 



\AX\^2Re sin^ 

where the radius of the Earth is Re ~ 
new parameters, 



6371 km. Defining 



0"+ 



ai + a2 



(Ji - (T2 



we can completely fix the relative position and ori- 
entation of a detector pair by the three parameters, 
(/3, cr+, (T_). In the coordinate system on the Earth, 
the overlap reduction functions, Eq. pip , can be reduced 
to 



j^{a, P, a+, (T-) = ey+(a, /3) cos(4(T+) 

+ev-ia, (3) cos(4ct_) , (36) 



Qv+{a, (3) 



3 45 169 
— ?n H 72 74 



1 ■ 5 , 27 , , 

2Jo + ^j2 + ^j4)cos/3 



ey_(a, /3) = 



• Scalar mode 



7n 79 74 cos , 

70 ^^J2 28-^4 1 ,2 



(37) 
(38) 



7'^(a, f3, <y+, cr_) 



Qs+ict, f3) cos(4cr+) 
+es_(a, /3) cos(4(7_) , (39) 



es+(a, 13) 



3 45 507 
8^° + 56^^ + 448^^ 



1 . 5 . 81 , , 

2Jo + yj2-YY^j4)cos/3 



es-(a, /3) = 



^0 - yj2 + 1^4) COS 



(40) 
(41) 
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FIG. 6: (color online). Relative positions and orientations of a specific detector pair. The left panel shows the combinations 
(cos 4(T_ , cos 4a"+ ) . The right panel shows the combinations (/?, cos 4(t+). The possible optimal configuration, types (i) and (ii), 
are also shown in the left panel. 
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e 







AIGO (A) 


121.4 


115.7 


-45.0 


LCGT (C) 


53.6 


137.3 


70.0 


LIGO-Hl (H) 


43.5 


-119.4 


171.8 


LIGO-Ll (L) 


59.4 


-90.8 


243.0 


VIRGO (V) 


46.4 


10.5 


116.5 


TAMA300 (T) 


54.3 


139.5 


225.0 


GEO600 (G) 


47.7 


9.8 


68.8 



TABLE II: Positions and orientations of kilometer-sized in- 
terferometers on the Earth (in unit of degree), provided in 




detector pair 




0-+ 




separation [km] 


fc [Hz] 


A - C 


70.8 


31.4 


31.9 


7.38 xlO^ 


20 


A - H 


135.6 


45.1 


53.7 


1.18 xlO" 


13 


A - L 


157.3 


2.1 


38.0 


1.25 xlO"* 


12 


A - V 


121.4 


60.8 


20.2 


1.11 xlO"* 


13 


C - H 


72.4 


25.6 


89.1 


7.52 xlO^ 


20 


C - L 


99.2 


68.1 


42.4 


9.71 xlO^ 


15 


C - V 


86.6 


5.6 


28.9 


8.74 xlO^ 


17 


H - L 


27.2 


62.2 


45.3 


3.00 xlO'' 


51 


H - V 


79.6 


55.1 


61.1 


8.16 xlO^ 


18 


L - V 


76.8 


83.1 


26.7 


7.91 xlO^ 


19 



TABLE III: Relative positions and orientations of detector 
pairs on the Earth (in unit of degree) , and separation between 
two detectors and the characteristic frequency of the overlap 
reduction function. Each detector is represented by initial 
letters indicated in Table HIl 



C. Overlap reduction functions of specific detectors 

Let us consider the overlap reduction functions for an 
existing detector pair on the Earth. Given the relative 



coordinates (/?, (t+, (t_) of a detector pair, the overlap 
reduction functions can be plotted as a function of fre- 
quency. 

The positions and orientations of the currently operat- 
ing and planned kilometer-size interferometers are listed 
in Table |lll To specify the detector positions on the 
Earth, we use a spherical coordinate system {0, (f>) with 
which the north pole is at = 0°, and (j> represents the 
longitude. The orientation angle ^ is the angle between 
the local east direction and the bisecting line of two arms 
of each detector measured counterclockwise. Hereafter 
we will consider only advanced (the second-generation) 
detectors: AIGOjl], LCGT 0, advanced LIGO (HI) 
and LIGO (LI) Q, and advanced VIRGO 6^, because 
the pairs of the advanced interferometers are more sen- 
sitive to a GWB and have more opportunity to detect a 
GWB. From the positions and orientations in Table [TTl 
the relative positions and orientations (/3, (7+, cr_) for 
each detector pair are determined, and are listed in Table 
mil The combinations are also illustrated in Fig.[6l The 
overlap reduction functions, calculated with the param- 
eter set (/?, tT+, (T_) for a real-detector pair, are shown 
in Fig.[7]and Fig.E 

The overlap reduction functions start to oscillate and 
decay rapidly above the characteristic frequency fc, given 
by fc = cj (2| AX|). Numerical values of fc for specific de- 
tector pairs are listed in Table Hill At low frequencies, the 
functions approach constant values, whose value are de- 
termined by the relative orientation of the detector pair. 
The difference of the behavior between the polarization 
modes appears at around the characteristic frequency. 
Mathematically, this is because the coefficients of jo in 
Eqs. dMl) and dSS]), dST]) and dM]), and (gO]) and dH]) are 
exactly the same, while the coefficients of j2 and are 
different (jo — > 1, j2 ^ 0, and j4 — > 0). At much higher 
frequencies, since the overlap reduction function signif- 
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FIG. 7; (color online). Overlap reduction functions for real-detector pairs on the Earth. Each curve shows tensor mode (red, 
solid), vector mode (green, dotted), and scalar mode (blue, dashed). 



icantly reduces, the most interesting frequency range is 
around the characteristic frequency, e.g., ~ 10 — 100 Hz 
for the detectors on the Earth. 



D. Optimal detector configuration 

There are three parameters specifying the detector 
configuration. We seek an optimal detector configura- 
tion, which maximizes the SNR given in Eq. (j30p . From 
the overlap reduction function in Eqs. and 
([M)) . the optimal configuration of the detectors can be 



classified into two types: 

Type (i) : cos(4(t+) = - cos(4(t_) = ±1 , 
Type (ii) : cos(4(t+) = cos(4(t_) = ±1 , 

which are illustrated in Fig.[9l In type (i), the solutions 
are tri = 7r/4 mod tt, 02 = — 7r/4 mod tt for the plus 
sign, and a\ — 7r/4 mod tt, 02 — "k mod tt for the mi- 
nus sign. This means that the great circle connecting two 
detectors is parallel to one of the arms of both detectors. 
As for type (ii), the solutions are tii = mod tt, <72 — 
mod TT for the plus sign, and ai = 7r/2 mod tt, (T2 = 
mod TT for the minus sign. This corresponds to the case 
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FIG. 8; (color online). Overlap reduction functions for real-detector pairs on the Earth. Each curve shows tensor mode (red, 
solid), vector mode (green, dotted), and scalar mode (blue, dashed). 



in which the great circle connecting two detectors is par- 
aUel to the bisector of the two arms of each detector, or 
is directed in the orientations that one of the detectors 
is rotated by multiples of 7r/2 from the former. There- 
fore, the optimal configuration is realized when one of the 
arms of the two detectors is parallel or rotated by multi- 
ples of 45 degrees, relative to the great circle connecting 
two detectors. Note that both types of the configura- 
tions are not simultaneously optimal one. Whether the 
configuration is optimal or not depends on the signs of 
the functions Qm+ and Qm-, M = T, V, S. 



E. SNR 

We calculate the SNR for each mode with two detec- 
tors, assuming that only one polarization mode (tensor, 



vector, or scalar mode) exists. The separation of the po- 
larization modes is addressed in the next section. 



The SNR for each polarization mode can be calculated 
by using the formula, Eq. (|30p . As for the power spectra 
of the detector noise Piif), we assume that, for simplic- 
ity, all advanced detectors (A, C, H, L, V) have the same 
noise as that of advanced LIGO. The analytical fit of the 
noise power spectrum of the advanced LIGO, based on 
is given by do] 



Pif) = { 



10" 

10 

oo 



/ 



10 Hz 



-46 ( f 



V 1000 Hz 



10 



Hz-i 



-47.25 



( f 



V 100 Hz 



Hz" 



for lOHz < / < 240 Hz , 

for 240 Hz < / < 3000 Hz 
otherwise . 
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FIG. 9: (color online). Optimal configurations of a detector 
pair. For a fixed orientation of the interferometer 1, all pos- 
sible orientations of the optimal interferometer 2 for a fixed 
separation {3 are illustrated. 
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FIG. 10: (color online). Normalized SNRs of the detector 
pair of type (i) (solid lines) and type (ii) (dotted lines) as 
a function of /3. The tensor, vector, and scalar modes are 
represented by red, green, and blue curves, respectively, as 
indicated on the right side of the figure. 



In the SNR calculation, we assume that the f2gw is in- 
dependent of frequency, i.e., figw is const.. It is useful 
to write the results for each mode with normalized SNR, 
defined by 



normalized SNR = 



SNR(/3) 
SNR(/3 = 0) 



where 



SNR(/3 = 0) « 9.7 X 



T 

Syr 



1/2 



gw 
10-9 



(/igrigw has to be replaced with ^/igilgw for the scalar 
mode). Note that the above value of SNR(/3 = 0) is iden- 
tical for each polarization mode, because of the degener- 
acy of them at the low frequencies. 

In Fig.[Tni the normalized SNRs for the possible op- 
timal configuration of detector pairs, type (i) and (ii), 
are shown as a function of (3. Interestingly, most 
of the detector pairs have almost the same sensitiv- 
ity to the three modes. In Fig.[TTl the optimal SNR, 
max {SNRItypefi), SNR|type(ii)}, is shown as a function of 
/?, together with SNRs of specific detector pairs for each 
mode. The SNRs of the specific detector pairs, except 
for AIGO-LIGO (HI) and AIGO-LIGO (LI) pairs, are 
smaller than the optimal one due to the incomplete co- 
incidence of the detector orientations. It is interesting to 
note that the SNR of the optimal detector configuration 
for the scalar mode is enhanced at the distance relatively 
close, while that for the tensor mode is enhanced at the 
distance relatively far. This feature can be intuitively in- 
terpreted by the angular responses of the detector shown 
in Fig. 131 At /3 ~ 7r/2, the angular responses of the ten- 
sor mode between two detectors are less overlapped than 



those of the scalar and vector modes. On the other hand, 
at ~ TT, the angular responses of the tensor mode be- 
tween two detectors are more overlapped. 

SNRs with a specific detector pair are tabulated 
in Table IIVI As anticipated from Fig. [Til ^ laser- 
interferometric GW detector is sensitive to a GWB with 
the non-tensorial polarizations, having almost the same 
SNR as the tensor mode. 

For further understanding of the distance dependence 
of each polarization mode, it is helpful to consider an an- 
tipodal detector pair on a virtual earth with an arbitrary 
radius R. The SNRs of the antipodal detector pair de- 
pend only on the distance between the detectors. In the 
antipodal case, setting (3 — tt and (7+ = 7r/4 (cti = and 
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TABLE IV: Detectable GWB (SNR = 5) with a real-detector 
pair in the presence of a single polarization mode. The obser- 
vation time is selected as T = 3 yr. 



13 



optimal 




0.5 1 1.5 2 2.5 3 



13 [rad] 



antipodal 




D [km] 



FIG. 11: (color online). Normalized SNRs of the optimal 
and real detector pairs as a function of j3. Each curve 
shows max {SNR|type{i) , SNR|typo(ii)} for the tensor mode 
(red, solid), the vector mode (green, dotted), and the scalar 
mode (blue, dashed). The squares (red), diamonds (green), 
and triangles (blue) are the normalized SNRs of real detector 
pairs for the tensor, vector, and scalar modes, respectively. At 
the arrow, four points are overlapped: (detector pair, mode) 
= (2, tensor), (2, vector), (3, vector), and (3, scalar). The 
numbers in the figure represent the real-detector pair: 1=HL, 
2=AC, 3=CH, 4=LV, 5=HV, 6=CV, 7=CL, 8=AV, 9=AH, 
and 10=AL. 



a2 — IT /2) gives the overlap reduction functions, 

1 



is 



Jo 



10 

7 

5 

r 

10 



IT = Jo - yj2 + Y^J4 , 



IV = Jo + yj2 - yj4 , 



-J2 



;J4 



7 ■' T 

The separation between the detectors is 
D = lAXI = 2R . 



(42) 



Given the overlap reduction functions, we can compute 
normaUzed SNRs, which are shown in Fig.[T2 The SNRs 
monotonically decrease proportional to the separation 
between the detectors. At relatively small distance, the 
SNR for each polarization mode is comparable to each 
other, while at relatively large distance, the SNR of 
the tensor mode shows slower decay than that of other 
modes. 



V. MODE SEPARATION 

In practical observation of a stochastic GWB, three 
polarization modes of a GWB are mixed in the detector 
cross-correlation signal. The decomposition of the modes 
is an important issue. In this section, in the presence of 



FIG. 12: (color online). Normalized SNR of an antipodal 
detector pair as a function of the separation D. The tensor, 
vector, and scalar modes are represented by red (solid), green 
(dotted), and blue (dashed) curves, respectively. In the case 
of the (real) Earth, the separation is D ~ 1.27 x 10* km. 



all polarization modes (tensor, vector, and scalar), we 
discuss how to separately detect each polarization mode 
of the stochastic GWB. 

Let us consider the case in which three detectors are 
available. From Eq. ([TO]) , the cross-correlation signal be- 
tween the / th and J th detectors is given by 



M/J = {Yij) 



df{sKf)Sji.f))Qif) 



(43) 



Comparing Eq. (fT9)) with Eq. ([2T|) . we define a statistic 



Zuif) 



ifi'smsjif) 



H^l^iDlfAf) + a noise term . 

This statistic contains the contribution from noise terms. 
However, by taking ensemble average, the noise terms 
vanish, because we are assuming that the detector noises 
are independent each other. Then, we obtain three cross- 
correlation signals 



(44) 




with a detector correlation matrix 



n 



TVS 
7l2 7l2 7l2 

TVS 
723 723 723 

TVS 
731 731 731 



(45) 



where the subscripts, I,J = 1,2, and 3, discriminate 
the detectors. Therefore, the modes can be separated by 
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inverting Eq. (|44| . namely, 




n 



The explicit expression of H ^, which we call a separa- 
tion matrix, is 




n 



1 



detn 



723731 

7f37il 

T V 
723731 



7f3731 731 7f2 
723731 73l7l2 



V T 
723731 



T V 
73l7l2 



7fi7i2 7i27f3 

73l7l2 7l2723 

V T TV 

731 7l2 7l2723 



7f2723 

7^2713 
V T 
712723 



(46) 



with 



det n = 7l2(7l'37fl - 73'l7l3) + 71*2(713731 " 73l723) + 7f2(723 73'l - 73172^3) 



S „,T - 



,.T ^y ' 



For the mode separation, the condition, det 11 0, is 
required and should be checked. As we will verify later, 
in the case of the specific detectors on the Earth, we can 
safely perform the integration of the SNR. 

Next, we derive the SNR formula for separate detec- 
tion of each polarization mode with three detectors. The 
GW signal and detector noise are given by replacing 
s*j{f)sj{f) in Eqs. (|43|) and ([26]) with a certain combi- 
nation 

VMl im if)S2 {f)+riM2 im (/)S~3 {f)+riM3 im (/)S~1 (/) , 

where rjMiif), i = 1,2,3, M — T,V,S, are the proper 
components of the inverse of the separation matrix, n~^, 
e.g., to separate the tensor mode, rjTi = (7237-fi ~ 
72ls73^i)/detn, 1JT2 = (73^1 7f2 " 73^171^2)/ det H, and 
VT3 = (71^272^3 - 7f2 72^3)/ detn. Then, the GW signal 
for each mode, M = T,V, and S, is 



Mm 



ml 

207r2 



T 



df\f\-' [riMi{f){Zi2{f)) 



+VM2{f){Z23{f))+VM3{f){Z3l{f))]Q{f) , 

(47) 

and the detector noise (the variance of ji) is 

= J / dfirjinimnfmm 

^ J —00 

+ vinimmpsm+vinimmpim] 

X \Qif)\^. (48) 

Hereafter we omit the subscript M for the simplicity of 
the expressions. Note that, however, Hg, Hn, and SNR 
below are different functions for each polarization mode. 
Defining 



Hgif) ^ mimzi2if))+mif){Z23if)) 
+mimz3iif)) , 



(49) 



HM) ^ Wi{I)Pii\I\)P2{\f\) + ril{f)P2{\f\)P3m 



+%'(/)P3(|/|)Pl(|/|)] 



1/2 



and an inner product 



{A,B) 



dfA*{f)B{J)HlU) , 



we can write Eqs. (|47)) and (I48p into 



207r2 



(51) 
(52) 



Thus, to optimize the SNR, the optimal filter should be 
chosen as 



\I?Hl{f) 



Substituting the specific form of the optimal filter in 
Eqs. ([51]) and ([52]) . one obtain the SNR formula after the 
mode separation as 



SNR = 



df 



\f\'mf) 



1/2 



(53) 



Using this formula, we calculate the SNRs. For sim- 
plicity, we assume that all detectors have the same noise 
power spectrum, P(/) = Pi(/) = P2(/) = Psif). In this 
case, Hg/H^ in the integrand of Eq. ([55)1 can be writ- 
ten down explicitly. Substituting Eqs. and (I5D1) into 



(50) / H^^ and using the components of Eq. (HS)) give 
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FIG. 13: (color online). Plot of a squared effective overlap re- 
duction function, WAi{f), for the H-L-V detector set. No di- 
vergence of the function occurs in an observational frequency 
band. 



In the above equations, we define the function Wa/(/), 
M = T, V, and S. Comparing Eq. ^ with Eq. we 
can interpret vWm(/) as an effective overlap reduction 
function in the case of the polarization mode separation 
with three detectors. As we noted earlier, the condition 
detn ^ is needed in order to successfully separate 
the polarization modes. However, we can safely perform 
the integral, because the contribution to the SNR auto- 
matically drops out from the integral when detll = 0. 
Another concern about the integral is the pole of V1/m(/)- 
For completeness, we checked that W^m(/) of all three- 
detector sets do not diverge at any frequency in the ob- 
servation frequency band, as an example, which is shown 
in Fig.IH 

Assuming that GWB spectra are independent of fre- 
quency and that observation time is T = 3 yr, we obtain 
the SNRs after the mode separation with three specific 
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TABLE V: Detectable energy density of GWB with SNR = 
assuming T = 3yr. 



5, 



detectors. The detectable GWB-energy density with ad- 
vanced detectors with the detection threshold SNR = 5 
is shown in Table |Vl In comparison with the SNRs in 
the presence of a single polarization mode in Table IIVI 
three detector combinations have almost the same sensi- 
tivity to three polarization modes even when the modes 
are separated. 

Although we considered the three-detector case above, 
one can also perform the correlation analysis with more 
than four detectors [s^ H^. In the case of TV detec- 
tors available, there are A^pair — N{N ~ l)/2 correlation 
signals from detector pairs. Then, the number of inde- 
pendent combinations for the three-mode separation is 
A^pair — 2. The additional combinations can be exploited 
in order to optimally weight the correlation signals and 
to enhance the SNR. Such an analysis with multiple- 
detector pairs has been done in i4Qj. However, the 
SNR is not significantly improved when noisy or largely 
separated detectors are added, because the SNR is mainly 
determined by the sensitive three detectors among the de- 
tector network. Therefore, in the case of more than four 
detectors, the SNRs are not much different from those 
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provided in Table |Vl 



APPENDIX A: TENSORIAL EXPANSION OF 
OVERLAP REDUCTION FUNCTION 



VI. DISCUSSIONS AND CONCLUSIONS 



In this paper, we investigated the detectabihty of ad- 
ditional polarization modes of a stochastic GWB with 
ground-based laser-interferometric detectors. Such po- 
larization modes, in general, appear in the extended theo- 
ries of gravitation and the theories with extra dimensions, 
and can be utilized to constrain the theories beyond GR 
in a model-independent way. We extended the formal- 
ism of the cross-correlation analysis, including the addi- 
tional polarization modes, and calculated the detectable 
energy density of the GWB. In the presence of a sin- 
gle polarization mode, a detector pair has almost the 
same sensitivity to tensor, vector, and scalar modes, and 
can detect the GWB of /igf^gw ~ lO'^ with SNR = 5. 
We showed that the mixture of the three polarization 
modes in the correlation signals can be separated with 
more than three independent detectors at different sites, 
and that the separation does not significantly affect the 
SNR, which is comparable to the SNR obtained in the 
presence of a single polarization mode. It is interesting 
that the most sensitive detector set for one polarization 
mode does not necessarily coincide with that for other 
polarization mode: the best detector set is A-H-L for the 
tensor polarization and A-C-H for the vector and scalar 
polarizations (The noises of all the detectors are assumed 
to be identical with that of advanced LIGO.). 



We showed that the existence of the non-tensorial po- 
larization modes in a GWB can be probed with more 
than three detectors. What we know from the observa- 
tion is the energy density of the GWB for each polar- 
ization, which is present in the Universe. If the GWB 
is not detected, we obtain the upper limit. To select 
the correct theories or constrain the theories, we need 
to compare the GWB spectrum obtained in the obser- 
vation with that predicted in a specific theory. So, the 
derivation of the GWB spectrum in a specific theory is 
the important issue that should be addressed, but we will 
leave it for future work. 



In this Appendix, we provide a tensorial expansion of 
the overlap reduction function, which allows us to per- 
form the angular integral about a GW-propagating di- 
rection, without specifying a detector configuration. 

Defining 

AX = Xi-X2 = |AX|d , 



«(/) 



and 



(Al) 



(A2) 



(A3) 



the overlap reduction functions, Eqs. (|^ . and (IM)) . 
can be written as 



7^^(/) = n'-'"Z?"ri^L(a,d), 



(A4) 



where the superscript M distinguishes polarization 
modes, M — T (tensor), V (vector), and S (scalar). 
However, since the following calculations are parallel for 
all polarization modes, we omit M = T,V, and S. In 
Eqs. (|A1|) . (jA2p . and (jA3|) . the summation about the po- 
larizations is ^ +, X for the tensor mode, A = x,y 
for the vector mode, and A = b,£ for the scalar mode, 
respectively. 

The tensor r^Tj^ has the symmetric properties. 



ijkl — i jikl , ^ijke — i ijik , -L ijke — -L klij 



Consequently, thanks to the symmetries, Tijki can be 
expanded in tensorial bases as 
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+ C'3{a){Sijdkde + SkAdj) 
+ C4{a){Sikdjde + S^djdk + Sjkdide 
+djididk) + C5{a)didjdkdg . 

(A5) 

Here we define the contracted quantities of Tijki with 
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the tensorial bases, 



91 


= i rjklO , 










93 






94 






95 







Then, from Eqs. and gi, • 

to the coefficients Ci , • • • ,6*5 by 



92 
93 
94 



/ 9 6 6 4 1 \ 

' 6 24 4 16 2 ' 

6 4 8 8 2 

4 16 8 24 4 

V 1 2 2 4 1 y 



(A6) 

, gs can be related 



C2 ^ 

C3 



or, inversely, 



C2 ^ 

C3 

\c,/ 



/ 3 -1 -3 1 1 \ 

'-11 1-11' 

-3 1 5-1 -5 
1-1-12 -5 

V 1 1 -5 -5 35 y 



92 
93 
94 

V95y 



(A7) 



On the other hand, from Eq. (|A1[) . gi, • • • ,95 can be 
exphcitly integrated with respect to the propagation di- 
rection of GWs over the celestial sphere, by temporarily 
introducing a coordinate such that 



Jl • d = cos (5 = x, m • d = 0, n • d 



' sin (5, 



and by using the integral formulae of spherical Bessel 
fmictions 



dx e* 



cixe*"^(l-x2) 



2jo(a) , 



dx e^""=a;2 



-1 
1 



dx e'^'^'x^ 



16 

2 
3 
2 

35 



a 



jo (a) - 2j2(a) 
7jo(a)-20j2(a)+8j4(a) 



and the relations between the spherical Bessel functions 
with different indices. 



ji(Q) 
a 

i2(a) 
a2 



1 
105 



io(a) + j2(a) 

7jo(a) + 10j2(a)+3j4(a) 



Then, Ci , • • • , C5 in Eq. (|A7p can be expressed in terms 
of the spherical Bessel functions. The results are 
• for tensor mode 



91 = , 92 = 20jo(a) 



93 = 0, 



94 = 40- 



95 = 20M^ 



C2 * 

C4 

Vcsy 



1 

42 



-28 


80 






42 


-60 


3 


/ Jo 





-120 


-15 


\n 





90 


-15 


VJ4 








105 y 





for vector mode 

91 = , 92 = 20jo(a) , 93 = 
20 ' 



95 = 20 



IC,\ 
' C2 * 

C3 
Ci 

\c,J 



2io(a) - ^2(0:) 



114 

— i[)(oi) 72(a) iiiot) 



1 

42 



-28 


-40 


-12 \ 




42 


30 


-12 


/ Jo 





60 


60 


J2 





-45 


60 


VJ4 








-420 y 





• for scalar mode 
2 + K 



91 

92 

93 

94 

95 



30 
60 



1 + 2k 
1 + K 



1 + 2k 



Jo (a) 
Jo (a) 



20 



1 + 2k 

40 
1 + 2k 
2 



(2 + K)jo(a) + 2(l-K)j2(a) 
(l + K)jo(a) + (l"2K)j2(a) 



7 



7(4 + 3K)jo(a) + 20(2-3K)j2(a) 



+12(1 + K)j4(a) 
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' C2 

C3 

C4 



1 

7(1 + 2k) 



/ 14(3 + k) 
7(1 + 2k) 



V 



-20(3- k) 
10(1 + 2k) 
30(3 - k) 

-15(1 + 2k) 




3(1 + 
3(1 + 

-15(1 
-15(1 
105(1 



2k) 
2k) 
f 2k) 
f 2k) 

h2K) / 




From Eqs. (jA4[) and (|A5p together with the traceless 
property of Dij, the overlap reduction function can be 
written as 

7(/) = piia)D'W,, + p2{a)D\D''^dJ, 

with the redefinitions of the coefficients, pi{a) = 26*2(0;), 
P2(a) = 4C4(a), and ^3(0;) = 6*5(0). The new coeffi- 
cients are given by 

• for tensor mode 







(1) 












5 




( jo 


-15 




h 










for scalar mode 







(3) 








for vector mode 



14 20 6 
-60 -60 
105 



Note that the parameter k vanishes in the overlap reduc- 
tion function, because Fi, and have the same response 
and 7 is normalized. 
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